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The impact of "The Great Lake Erie, 99 an outreach 
program that aimed to improve visitor knowledge and attitudes about 
Lake Erie, is discussed in this evaluative study. "The Great Lake 
Erie" was presented as a two-part program consisting of a lecture and 
demonstration stage presentation and a series of exhibits. The 
program was open to school groups during weekdays and to the general 
public on weekends and evenings. Visitor behavior at the exhibits was 
monitored, and the 17 displays were evaluated on their 
attention-holding ability, knowledge impact, instructional component, 
accommodation potential, and self-direct iveness . The highest rated 
exhibits tended to be self-directive and highly interactive. To 
assess knowledge and attitude changes related to the program, a 
pretest-postest questionnaire was completed by visiting adults and 
students. Students and adults responded differently to the program. 
Adults showed significant knowledge gain while students did not. On 
attitudes, students and adults were positive on the pretest, but only 
students showed a positive shift on the post test. Positive feedback 
was obtained from teachers who participated in the program with their 
classes. A diagram of the display area and exhibit design, as well as 
observation form, are included. (ML) 
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BACKGROUND 

Surveys have demonstrated that the Importance of the Great Lakes, 
and Lake Erie In particular, Is not well understood throughout Ohio 
[1, 23 • Important concepts Include: A) The most Important highway 
system In the world Is the Great Lakes system. The Great Lakes supply 
the lowest cost for transportation of goods and services and 
consequently provide major economic Impacts to the entire midwest 
region of the United States* B) Geological history Is Interesting as 
well as tremendously Important because of the need to understand shore 
processes. MM lions of dol lars are annual ly spent and lost attempting 
to control erosion. C) The recreational opportunities provided by the 
lakes account for one of the major Industries of the midwest and are 
Important for tourism as well as having a positive Impact on atttudes 
of citizens toward our natural environment. D) Over 11 million people 
depend on Lake Erie for drinking water on a dally basis. The future 
of this wa,^r resource, not only to the midwest but to other areas of 
this country, and the political Implications of ownership and control 
over water resources will be significant Issues In the near future. 
E) Within the water system Is another Important resource — the I If a 
forms. Lake Erie lb a wal l-fertl I Ized, sometimes overf ertl I Ized, body 
of water with an extremely large blomass. More fish are harvested for 
human consumption from Lake Erie than from al I the other Great Lakes 
combined. 

Knowledge 1ests among Ohio students [13 found that fifth graders 
can answer correctly about 38% of questions on Interdisciplinary 
aspects of Great Lakes Information, and ninth graders score about 48% 
correct. Adults surveyed on scne of the same topics L23 could answer 
49% of Items correctly on a knowledge test. These respondents had 
slightly positive attitudes abou + Lake Erie's Importance to Ohio, and 
less positive attitudes about the lake's Importance to the United 
States as a whole. 

Much evidence exists that attests to the measurable Importance of 
nonformal educational Institutions ar< settings for affective and 
cognitive learning [3, 4, 53. According to the American Association 
for the Advancement of Science [63 > "out of school programs In science 
can enrich and extend the science learned In school. The In-depth, 
hands-on study of one aspect of science Is the critical Influence that 
has Inspired many young people toward a science career. 11 
Recognizing the Importance of such Institutions In the development of 
science literacy, the National Science Foundation has recommended that 
Increased emphasis be placed on the expansion and maintenance of hign 
quality nonformal education programs [73. 

Since 1964 the Center of Sclencx and Industry (COS I ) In Columbus, 
Ohio, has provided both recreational and educational experiences for 
325,000 visitors annual ly. Part of COSI's mission In Ohio has been to 
bring science and technology to people In easily comprehensible forms, 
and through Its extensive educational r r °9 rafn offerings It provides 



demonstration show was presented twice for attending adults and family 
groups. More tine was available for lingering In the display area 
before and after the demonstrations* since bus schedules and incoming 
groups did not force visitors Into specific time slots as school 
groups had been. 

instruments. A "focal exhibit 11 Instrument [10] was developed to 
assess the attention-holding ability (Interest) In the exhlblls. 
Numbers and activities of visitors at a particular exhibit were 
recorded by two trained adult observers for three minutes at i5 second 
intervals. The recording form was pilot tested and refined by a group 
of graduate students at 00S! In Columbus. The behavior categories for 
the observation record Included Interacting with the exhibit. 
Interacting socially, Interacting both with the exhibit and socially, 
and passive (nonmanlpulattve) Interaction with the exhibit (Figure 2). 
In order not to bias the observations by time of observation or number 
of people around any exhibit, a predetermined sequence of exhibit 
monitoring was followed (Figure I dashed line) for the first recording 
period (on~ group of students for 45 minutes). The sequence was 
reversed for a second period, and for a third It was started In the 
middle. This type of evaluation was used only among students, not 
adults. 

Exhibits were classified as to whether they had a strong 
instructional component or were mainly entertaining or motivational; 
whether they were self-directing or required explanation or 
assistance; whether the amount of space and materials would 
accommodate several visitors at once, and whether their Informational 
components were reflected in the knowledge changes measured by the 
pre- and posttests. 

Since The Great Lake Erie was intended to be educational tool 
the study also utilized a pretest - posttest design to assess 
knowledge and attitude changes related to the program. The same 
questionnaire (readability Grade 6) was used for both students and 
adults. Its 15 questions Included 2 demographics, 4 LIkert scale 
attitude Items about the value of Lake Erie, and 9 multiple choice 
knowledge Items specific to the content of the presentation, the 
displays, or both. Most Items were derived from an earlier test of 
Great Lakes Information [1]. The tests were developed In three forms 
which differed In the knowledge items only (Appendix A). This al lowed 
the testing of three times as much Information from the groups. The 
three test forms had paral lei subject areas for the 9 knowledge Items 
(I.e., all contained items on water qual ity, lake transportation, 
historical quotations, etc.), but content of the individual Items was 
different. 

COS I developed a teacher questionnaire to assess general 
Impressions of the program. It was completed upon the teacher's 
return to school. Teachers were also requested to have their students 
write letters to the presenter, and the student perceptions 
constituted a final form of evaluation. 

Subjects. Students attending the program on one day from middle 
school grades In two schools answered the pre- and posttests, a total 
of 152 and 296 respondents, respectively. Only one class taught by a 
teacher from the teacher training program was among the tested group 
on the chosen dates. The pretest was administered to student groups 
(7th and 8th grades) In their classrooms before they visited the 
program. The posttest was answered by students on their buses as they 
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returned to school, or In some cases back In their classrooms* Thirty 
adults were randomly selected for testing at the entry and exit doors 
during the middle weekend of the show. One adult declined to finish 
the entry survey, so her data were excluded from analysis. Some adult 
visitors (18% of the totai) responded to both pre and posttests, but 
none to the same test form each time. 

RESULTS AND DISCUSSION 
Exhibit Interest* The focal exhibit observation form proved very 
difficult to use In the context of the student groups at Flndlay. 
Because of the way the program was designed, groups of 150 students 
were released from the demonstration program at one entrance to the 
display area at one moment* The initial confusion lasted several 
minutes, during which some exhibits nearest the entrance were 
surrounded and most others were ignored. As the exploration period 
continued, better observation conditions were established, but the 
planned sequence of observations was not completed within any group's 
stay In the exhibit area. 

s An attempt was made to rate exhibits for their Interest level, 
defined as attention-holding ability, as measured by the focal exhibit 
Instrument (Table 1). Based on 1) the number of student visitors at 
each exhibit, 2) the portion of the evaluation tiro they remained 
there, and 3) the amount of Interaction with the exhibit, a score of 
1-6 was assigned for each exhibit. Two points were possible for each 
criterion. The highest ranked exhibits tended to be self-directed and 
highly interactive (see descriptions, Appendix B). Some exhibits were 
attended by COS I staff or community volunteers who explained their 
content or directed activities. These were among those ranked next 
highest In Interest. Linn [4] predicted that such exhibits would 
have the highest attractiveness, and In this case they did attract the 
most students- Interest measures for this study also Included other 
criteria, however. The amount of passive behavior and purely social 
interactions exhibited by the students at these stations were enough 
to lower the Interest scores below those of exhibits that actually 
Involved participation. 

Exhibit characteristics. Table 1 also Indicates the ratings of 
exhibits on other measures: whether the exhibit contained specific 
Instructional components (+) or was motivational only (0), whether 
Information tested on the pre- and posttest was included, how well 
visitors could be accommodated In the area (space, amount of equipment 
for hands-on), and whether the exhibit was sel f-dl rectlng or not. 
Ratings were totaled Into an exhibit score for their contribution to 
this program. The totals tend to be weighted toward the attention 
holding traits of the displays. The microcomputer simulation of a 
food chain, the rock salt cleavage activity and the water sampl Ing 
barrels were ranked highest. 

Information from these activities was also reflected In gains on 
specific test Items of student and adult respondents. For example, 
Item 1 5A: A mineral that Is mined from beneath Lake Erie Is..., 
registered great increases in awareness. Students answering the 
question went from 37% correct on the pretest to 67% on the posttest, 
while adults went from 40% correct to 87%. Test Items related to 
relatively passive exhibits registered gains In knowledge, but not of 
this magnitude. 

Knowledge and Attitudes. Students and adults responded 



differently to the program* Adults showed significant (P<0*01) 
knowledge gain (Table 2), while students did not* For example* on 
Question 11 A: The substance most responsible for Lake Erie's water 
quality problems Is...* adult responses correctly identifying 
phosphates went from 3QBK on the pretest to 62% on the posttest* The 
majority of students* on the other hand* selected "industrial wastes 19 
on both tests* Those students whose teacher had received inservice 
training did show greater know lege gain as predicted [8* 11]* but not 
at a significant level* It may be that the "novel setting" of this 
f le'd experience Interfered with the acquisition of knowledge for the 
students [12]* while adults with more experience in varied settings 
were able to maximize their knowledge gain* 

On attitudes* students and adults were positive on the pretest* 
and only students showed a significant shift on the posttest (more 
positive)* Attitudes may have been affected by the students 1 levels 
of Involvement with the exhibits* many of which were designed as 
motivational devices* Previous research [8] has indicated that* 
overall* adults are hesitant to manipulate objects while children 
freely touch and interact with exhibit parts* Future research will 
compare adult responses using the focal exhibit technique* The iow 
pub I ic attendance at this pilot program did not al low adequate 
appl icatlon of the method among adults* 

Teacher Perceptions. On COS Ms questionnaire* 90% of the 
teachers (N»107) rated the over a I I experience as "excel lent 11 or "very 
good*" On a scale of 1 to 5* with 5 = excellent* teachers rated the 
content and process evaluation items from 4*1 to 4*6* Lowest ratings 
were given on an Item regarding the Interaction of COS I staff with 
students* This could be attributed to the crowded conditions* with 
150 students in the exhibit area at a time* 

Student Percept I ons c Only teachers in elementary schools were 
asked to have their students write letters to "Mr* COS I." the 
presenter* after the program* since these students did not take the 
pre- and posttests. Student letters tended to focus on spectacular 
portions of the demonstration program* such as the combustion of a 
hydrogen-filled ba I loon and pictures of wl I dl Ife kl I led by litter* 
Few references were made to the exhibits* but the most frequent 
comments on them were related to the need for more time In rhe display 
area and fewer students there at one time* 

SUMMARY 

This program served as a pilot projoct In bringing an educational 
"field setting" ( nto proximity with potential clients* It afforded an 
opportunity to assess the effects of the exhlbltry and demonstration 
programs from several perspectives* and several questions were 
answered* Attention-holding ability was adequately measured by the 
focal exhibit technique* and ideas for Improvement o* the method are 
being formulated* For those exhibits for which knowledge questions 
existed on pre- and posttests. attention-holding ability was related 
to knowledge gain* 

Adults gained knowledge from the program* and students 1 attitudes 
Improved. A frequent statement i>y the COS I lecturer for the program 
was "First you have to REACH them* then you can TEACH them." The 
combination of evaluation techniques used in this project indicates 
that both did occur* and the each of COS I and the Ohio Sea Grant 
Education Program was extended as wel I* 
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Figure 1. Focal Exhibit evaluation design for 'The Great Lake Erie/ Dash line indicates sequenc 
ERIC for observation. Sequence reversed for each evaluation period. 



Table 1 



Ratings of Enhlblts in "The Great Lake Erie" outreach program. 
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Focal eifhibit obseruation form 
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Exhibit: 

Time of day: 
Observer #: 
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Table 2 



Knowledge and attitude changes among visitors to 
"The 6 rent Lake Erie" outreach program. 





N 


Students 
Knowledge Attitudes * 


N 


Adults 
Knowledge 


Attitudes ¥ 


Pretest 


152 


50.5% 


4.28 


29 


57.3% 


4.16 


Posttest 


296 


51.5% 


4.51 


30 


64.7% 


4.20 



* 5 - most positive 

1 J 



LITERATURE CITED 

1. Fortner, R. W., & Mayer, V. J. Ohio students 1 knowledge and 
attitudes about the oceans and Great Lakes. Ohio Journal of 
Science* 1983. 83(5), 218-224. 

2. Fortner, R. W. Providing resource information through radio public 
service announcements. Agr I cl 1 hire Communicators In Education (ACE) 
Quarterly, 1981, 64(4), 19-34. 

3. Koran, J. J. , Jr., & Baker, S. 0. Evaluating the effectiveness of 
field experiences. In M. B. Rowe, (Ed.), What research says to the 
science teacher. Washington, DC: National Science Teachers 
Association, 1979. 

4. Linn, M. C. free-choice experiences: How do they help children 
learn. Science Education, 1980, 64(2), 237. 

5. Snelder, C. I., Easton, L. P., Friedman, A. J. Summatlve evaluation 
of a participatory science exhibit. Science Education, 1979, 63(1), 
25-36. 

6. Stern, V. W. , M. R. Redden and McCarthy. Out of school programs 
In science. Washington, DC: American Association for the 
Advancement of Science, 1981. 

7. National Science Board Commission. Educating Americans for the 
Twenty-First Century. Washington, DC: National Science Foundation, 
1984. 

8. Koran, J. J. Jr., Lehman, J. R., Shafer, L. D., I Koran, M. L. The 
relative effects of pre- anu postattentJon directing devices on 
learning from a "walk-through" museum exhibit. Journal of Research 
In Selene* Teaching, 1983, 20(4), 341-346. 

9. Mayer, Victor J. and Rosanne W. Fortner, The Ohio Sea Grant 
Education Program (Monograph). Columbus: Ohio Sea Grant, 1983. 

10. Altmann, Jeanne. Observatf onal study of behavior: Sampling 
methods. Behaviour, 1974, 49, 227-268. 

11. Gennaro, E. A. The effectiveness of using prevlslt 
Instructional materials on learning from museum field trip 
experience. Journal of Research In Science Teaching, 1981* 18(3)/ 
275-279. 

12. Falk, J. H., Martin, W. W., & Balling, J. D. The novel field 
trip phenomenon: Adjustment to novel setting Interferes with task 
learning. Journal of Research In Science Teaching, 1978, 1 5(2) # 
127-134. 

NOTE: This research was conducted through a grant to the author from the Office 
of Sea Grant, National Oceanic and Atmospheric Administration, U.S. Dept. 
of Commerce. Opinions expressed are those of the author only. 

ERJ.C 



